Prerequisites
Before using Amazon RDS for MySQL as an endpoint in a Replicate task, make sure the prerequisites outlined below have been met.
Driver prerequisites
Replicate on Windows
Install MySQL ODBC Unicode Driver 64-bit version 8.0.32 on the Replicate machine.
Replicate on Linux
-
Stop the Replicate service:
./areplicate stop
-
Optionally, confirm that the service has stopped:
./areplicate status
- Install MySQL ODBC Unicode Driver 64-bit version 8.0.32 on the Replicate machine.
-
Change the working directory to <Replicate-Install-Dir>/bin.
-
Copy the driver location to the site_arep_login.sh file:
echo "export LD_LIBRARY_PATH=\$LD_LIBRARY_PATH:/usr/lib64" >> site_arep_login.sh
This will add the driver to "LD_LIBRARY_PATH" and update the driver location in the site_arep_login.sh file.
-
Optionally, confirm that the driver location was copied:
cat site_arep_login.sh
-
Make sure that the /etc/odbcinst.ini file contains an entry for MySQL, as in the following example:
[MySQL ODBC 8.0 Unicode Driver]
Driver = /usr/lib64/libmyodbc8w.so
UsageCount = 1
-
Start the Replicate service:
./areplicate start
-
Optionally confirm that the service has started:
./areplicate status
Amazon RDS for MySQL replication
Replication enables data from a primary Amazon RDS for MySQL database server to be copied to one or more secondary Amazon RDS for MySQL database servers.
Data can be ingested from either a primary database server or a secondary database server.
To replicate changes from a secondary database server (CDC), the binary logging parameter log_slave_updates
needs to be set to true
(1
).
Setting up Amazon RDS for MySQL for CDC (Change Data Capture)
To set up Amazon RDS for MySQL or Amazon Aurora for MySQL for CDC:
-
Follow the instructions in the AWS Help for creating a new Parameter Group (see the Binary Logging Format section).
-
When creating the new Parameter Group, set:
binlog_format=row
- Save the new Parameter Group.
- If you have an existing instance of Amazon RDS for MySQL, edit the instance to use the parameter specified in Step 2 above. If you are provisioning a new instance of Amazon RDS for MySQL, reference the new Parameter Group created in Step 1 above.
- Finally, make sure that automated backup is enabled (the default).
Further reading: https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_LogAccess.MySQL.BinaryFormat.html
Replicating 4-byte UTF8 emojis
Replication of 4-byte UTF8 emojis to certain targets requires the following preparation:
- Microsoft SQL Server Target: Transform the emojis from
WSTRING(n)
toWSTRING(n*2)
. - Amazon Redshift Target: Transform the emojis from
WSTRING(n)
toWSTRING(n*2)
.
For information on defining transformations, see Using the Transform tab.